ABSTRACT
Resumen Las pruebas internacionales de aplicación masiva permiten evaluar los aportes de los factores individuales, familiares, institucionales y nacionales al logro educativo de los estudiantes expresado en su desempeño. En este contexto, el propósito de este estudio fue proponer y evaluar un modelo de efectos centrado en el procesamiento cognitivo esencial e incidental de las actividades académicas, de acuerdo con el desempeño en las pruebas de matemáticas en estudiantes de sexto grado de 15 países (y el estado de Nuevo León de México) que participaron en el Tercer Estudio Regional Comparativo y Explicativo (TERCE). Se formuló un modelo de ecuaciones estructurales en el que se calcularon índices de procesamiento esencial (control atencional, memoria de trabajo y supervisión familiar) y procesamiento incidental (violencia percibida, uso de ocio de la computadora -videojuegos, redes sociales, reproducción de contenidos, etcétera), con base en los ítems o preguntas utilizados en el TERCE. Los índices se diseñaron y obtuvieron según el Modelo de Rasch de la Teoría de Respuesta al Ítem (TRI). El modelo planteado afecta el desempeño en la prueba en 24 puntos. La variable con mayor tamaño de efecto es el uso de ocio de computadoras en el hogar. Los resultados se discuten a la luz de las hipótesis cognitivas sobre la distribución de recursos de atención y la de entrenamiento para entender el rol de las tecnologías de la información en el proceso formativo.
Abstract International tests of massive application allow evaluating how individual, institutional, national, and family factors contribute to students' educational achievement through their performance. Consequently, education evaluation is based on the paradigm of general and specific competencies for life. One of these general competencies is the capacity to solve mathematical problems and apply logical thinking to problem-solving. In order to evaluate this general competence, standardized tests have been developed. Among these tests, the Third Regional Comparative and Explanatory Study (TERCE) in 2013 evaluated the mathematical and other areas' academic performance of children in the third and sixth grade. The TERCE Mathematics evaluation allows researchers to capture the students' academic performance in five domains: numeric, geometric, measurement, statistics, and variation, as well as their cognitive performance in objects and elements recognition and simple and complex problem-solving. In addition, to evaluate these eight dimensions, the TERCE test also asks for information regarding academic context, family environment, and teachers, among others. Despite this information, in Colombia and in general, the evaluation of the socioeconomic context over academic performance has been studied mainly considering the schools' characteristics, families' economic levels, and public expenses. Therefore, there is little evidence of the effects of psycho-pedagogical and psychological factors on academic performance. Psycho-pedagogical models emphasize the dependence of the superior processes on perceptual and attentional processes and the need for activities that demand deep processing and active involvement with information before, during, and after classes. Thus, attending simultaneously to different elements affects the development of cognitive control functions, which leads to low academic achievement and performance. Frequently, students face academic activities in different scenarios where the attentional system should divide its resources between several stimulus sources. Activities in which the attentional system focuses are "essential processing", and those not related to the main academic activity are called "incidental processing". Consequently, increasing the sources of incidental processing would decrease the attentional resources devoted to the essential processing of educational activities producing low academic performance. In this context, the study proposes and evaluates an effects model focused on essential and incidental cognitive processing of academic activities. The information was captured on the mathematics performance of sixth-grade students from 15 countries (and the state of Nuevo León de México) participating in the Third Regional Comparative and Explanatory Study (TERCE). A Structural Equations model was formulated using indices of Essential Processing (Attentional Control, Working Memory, and Family Supervision) and Incidental Processing (Perceived Violence, Leisure use of the computer, and incidental processing) based on the items or questions used in the TERCE. The indices were designed based on the Item Response Theory (IRT) model. Findings show that the proposed model affects the performance in the test by 24 points. Higher scores in essential processing produce higher scores in the mathematics component of the TERCE test. Family supervision of academic activity is the single element with the highest impact on academic performance (3.020); on the other hand, attentional control (7.48) and working memory (4.295) also impact academic performance positively. Regarding the incidental processing variables, lower levels of perceived violence (1.680), less noise and distractor in class (2.130), and higher use of computers at home for leisure activities (5.851) have the most significant impacts on academic performance. The results are discussed considering the cognitive hypotheses on the distribution of attention resources and the training hypothesis to understand information technologies' role in the academic processes. Suggestions for further research focus on the inclusion of items with a higher theoretical background that allows researchers to evaluate the impact of essential and incidental processing on academic performance using items specially designed with that goal to get more conclusive and robust results.
ABSTRACT
Summative and formative assessments are two overlapping complementary ways of assessing student progress in regional anatomy teaching and learning. Our present study was designed to create a new holistic assessment system that embraces both summative and formative assessments, and evaluate its impacts on student performance of regional anatomy. A collection of five formative assessment tests were designed and introduced into the teaching process of regional anatomy, and their performances were combined with scores of the summative assessment taken at the end of the semester to form the holistic assessment. And an anonymous survey was conducted to gather student perceptions regarding the assessments. We found, compared to summative assessment scores, students' overall average points are higher by 4.67 points (P<0.05) and 9.23 points (P<0.01) when evaluated by the holistic and formative assessment; formative assessment scores are positively correlated to summative assessment scores, and the Pearson correlation is 0.624. Questionaire investigation showed 57.65 % of the students wishes to be assessed by the holistic assessmen, and 97.9 % of the students think that the holistic assessment can promote the frequency of student-teacher communication, which helps them form the right learning attitude and improve the performance. The results indicated that holistic assessment is a more reflective and practical approach of evaluating student performance in regional anatomy teaching, which can increase studentteacher communication and enhance the self-directed learning among students.
Las evaluaciones sumativas y formativas son dos formas complementarias superpuestas de evaluar el progreso de los estudiantes en la enseñanza y el aprendizaje de la anatomía regional. El presente estudio fue diseñado para crear un sistema nuevo de evaluación integral que abarque tanto las evaluaciones sumativas como las formativas, y evalúe sus impactos en el rendimiento de los estudiantes de la anatomía regional. Se diseñó e introdujo una colección de cinco pruebas de evaluación formativa en el proceso de enseñanza de la anatomía regional, y sus desempeños se combinaron con los puntajes de la evaluación sumativa tomada al final del semestre para formar la evaluación holística. Además, se realizó una encuesta anónima para recopilar las percepciones de los estudiantes con respecto a las evaluaciones. Encontramos que, en comparación con los puntajes de la evaluación sumativa, los puntos promedio generales de los estudiantes son más altos en 4,67 puntos (P <0,05) y 9,23 puntos (P <0,01) cuando se evalúan mediante la evaluación holística y formativa; los puntajes de las evaluaciones formativas se correlacionan positivamente con los puntajes de las evaluaciones sumativas, y la correlación de Pearson es 0,624. La investigación del cuestionario mostró que el 57,65 % de los estudiantes desea ser evaluado por los evaluadores holísticos, y el 97,9 % de los estudiantes piensa que la evaluación holística puede promover la frecuencia de la comunicación entre estudiantes y maestros, útil para formar una actitud correcta de aprendizaje y mejorar el rendimiento. Los resultados indicaron que la evaluación holística es un enfoque más reflexivo y práctico para evaluar el desempeño de los estudiantes en la enseñanza de anatomía regional, lo que puede aumentar la comunicación entre estudiantes y maestros y mejorar el aprendizaje autodirigido entre los estudiantes.
Subject(s)
Humans , Students, Medical/psychology , Educational Measurement/methods , Anatomy, Regional/education , Surveys and Questionnaires , Academic Performance , Correlation of DataABSTRACT
En el presente artículo se presentan los elementos teóricos que guiaron el subproyecto PAPIME No. 223003 "Evaluación de la práctica docente de los profesores de la Escuela Nacional de Enfermería y Obstetricia. Un enfoque formativo" En el primer apartado se abordan dos enfoques de la evaluación: el sumativo (cuantitativo) y el formativo (cualitativo) para distinguir la importancia de la elección de uno u otro. El primero está orientado a medir los resultados, el segundo, está centrado en los procesos, buscando proporcionar información sobre actividades que se desarrollan a fin de mejorar el desempeño a evaluar. En el segundo apartado se destaca la importancia de evaluar la práctica docente de los profesores a través no sólo de los estudiantes, informantes irremplazables, sino también de la mirada de los profesores sobre su práctica, por la importancia de conocer sus pensamientos al respecto, ya que consideramos que constituyen uno de los fundamentos para actuar sobre el currículo y sobre la mejora de sus prácticas. Concluimos considerando que este camino por recorrer hacia la evaluación formativa es un terreno fértil para la sensibilidad y la exploración de nuevas y efectivas formas de evaluación y estrategias de formación docente que conduzcan a la mejora del proceso formativo de los alumnos.
Theoretical elements which guided the subproject "PapimeTeaching Evaluation of the Escuela Nacional de Enfermeria y Obstetricia are presented in the following paper. In the first paragraph, two focuses of evaluation are considered: quantitative and qualitative to distinguish the choice of importance between one and the other. The first oriented to measure the results of the second, it is focused in the processes, looking to provide information about the activities that are developed to enhance the performance that is being evaluated. In the second paragraph, the importance of evaluating teaching practice, not only through the students, irreplaceable informer, but also through the point of view of the teachers about their own teaching and knowing about their thoughts and ideas is highlighted since we consider that they constitute one of the fundamentals to go about their curricula and the enhancement of their teaching practice. We can conclude that the road to formative evaluation is a fertile land for the sensitivity and exploration of the new and effective forms of the evaluation and strategies of teacher training which will lead to enhance the forming process of the students.